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In this paper, we establish a general relation which directly links the dissipated work done on a system 
driven arbitrarily far from equilibrium, a fundamental quantity in thermodynamics, and the Renyi divergences, 
a fundamental concept in information theory. Specifically, we find that the generating function of the dissipated 
work under an arbitrary time-dependent driven process is related to the Renyi divergences between a non¬ 
equilibrium state in the driven process and a non-equilibrium state in its time reversed process. This relation is 
a consequence of time reversal symmetry in driven process and is universally applicable to both finite classical 
system and finite quantum system, arbitrarily far from equilibrium. 

PACS numbers: 05.70.Ln, 05.30.-d, 05.40.-a 


The pioneering works by Clausius and Kelvin have estab¬ 
lished that the average mechanical work needed to move a 
system in contact with a heat bath at temperature T, from 
one equilibrium state A into another equilibrium state B, is at 
least equal to the free energy difference between these states; 
{W) > Fb - Fa, where the equality holds only for a quasi¬ 
static process. In a remarkable development Jarzynski IT] dis¬ 
covered that for a classical system initialized in an equilibrium 
state the work done under a non-equilibrium change of control 
parameters is related to the equilibrium free energy difference 
between the initial and the final equilibrium states for the con¬ 
trol parameters via 

Zip, Ai) 

Here p = l/T is the inverse temperature T of the initial equi¬ 
librium state of the system and we take the Boltzmann con¬ 
stant ks = 1, VT is the work done on the system due to a 
driving protocol under which the control parameter changes 
from Aj to Af, F is the Helmholtz free energy of the system 
and is defined hy F — -ksTinZ with Z being the equilib¬ 
rium partition function and the angular bracket on the left of 
Equation Q denotes an ensemble average over realizations 
of the process. The Jarzynski equality connects equilibrium 
thermodynamic quantity, the free energy difference, to a non¬ 
equilibrium quantity, the work done in a processes that may 
be carried out arbitrarily far from equilibrium. It implies that 
we can determine the equilibrium free energy difference of a 
system by repeatedly performing work at any rate. Jarzynski 
equality and Crooks relation fJl from which it can be derived 
have been verified experimentally in various physical systems 
EHini and were also proved to hold for finite quantum me¬ 
chanical systems lEHIl provided that work in a quantum 
system is defined by two projective measurements HI. The 
discovery of the Jarzynski equality has led to a very active 
field concerned with fluctuation relations in non-equlibrium 
thermodynamics HEHIIl. 

The excess work W-AF that arises in irreversible processes 
is often referred to as the dissipated work, Wdiss = VT - AF. In 
terms of the dissipated work, Jarzynski equality can be written 

as im, 

^ p (2) 


It is an identity that provides constraints on the dissipated 
work in an arbitrarily driven process. Contrary to the re¬ 
versible work, which only depends on the initial and final 
equilibrium states, the dissipated work depends on how the 
specific driven protocol is performed. Usually the driven pro¬ 
tocol is realized by changing the control parameters in the 
Hamiltonian between initial and final values, which can in 
principle bring the system arbitrarily far out of equilibrium. 
Surprisingly, there exists a neat and exact microscopic fluc¬ 
tuation relation for the dissipated work. The central result of 
this paper is the following relation: 

^ gfe-l)S;[0p«(T-f)0-‘|bF«]^ (3) 

where z is a finite real number, ITdiss is the dissipated work 
done on the system due to a driving protocol under which the 
control parameter changes from T, to Af in time duration t, 
the angular bracket on the left hand side denotes an ensem¬ 
ble average over the realizations of the driven process and 
- 0© ^IIpf( 0] is the order-z Renyi divergence be¬ 
tween ©Pr(t - f)0 ' and Pfit) with 0 being the time rever¬ 
sal operation. For classical system, the order-z Renyi diver¬ 
gence for distributions piiX) and p 2 (Z) is defined as mnn 
SzlPiWpi] = dXp\{X)p'jf'fX)]\. Pf{t) is the phase 

space density in the forward driven process measured at an ar¬ 
bitrary intermediate time t which was initialized in the canon¬ 
ical equilibrium state at inverse temperature p and control pa¬ 
rameter Ai and Pr(t - f) is the phase space density in the time 
reversed driven process measured at intermediate time r - f 
which was initialized in the canonical equilibrium state at in¬ 
verse temperature p and control parameter Af. For quantum 
system, the order-z Renyi divergence for quantum states pi 
andp 2 is defined as |l20ll2T] Sz\p\\\pi\ = ■^\n[Tx\p\p}p^]\. 
Pfit) is the density matrix of the system measured at an arbi¬ 
trary intermediate time t in the forward driven process which 
was initialized in the canonical equilibrium state at inverse 
temperature p and force parameter /!,■ and Pr(t - t) is the den¬ 
sity matrix at time t - f in the time reversed driven process 
which was initialized in the canonical equilibrium state at in¬ 
verse temperature p and force parameter Af. 

Since the concept of work in classical system and quan¬ 
tum system are subtly different iniEi, in the following we 
shall separately discuss derivation of Equation ([^ in non- 
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FIG. 1. (color online). Schematic illustration of the time rever¬ 
sal symmetry for classical system with time-dependent Hamiltonian. 
The upper red line with arrow towards right is a trajectory in the for¬ 
ward driven process, it starts at Xq and is driven by H[X, f 6 
[0, t] and arrives in X{t) at time t and finally ends in X^ at time t. 
The lower blue line with arrow towards left is its time reversed tra¬ 
jectory, which starts at ©Xj (time reversed state of Xj) and is driven 
by Hr[X-, f] = @H[X-, A(t - f)]0-' , t' e [0, t] and arrives in @i>S'(T - 1) 
after time t and finally returns to QXg at time r. 


equilibrium classical thermodynamics and in non-equilibrium 
quantum thermodynamics. 

Non-equilibrium classical thermodynamics- We consider 
a finite classical system with Hamiltonian where 

^ = {q\,P\',q 2 ,P 2 ',--' \qN,PN\ denotes collectively the co¬ 
ordinates and momenta of all the N particles in the system, 
/I is a parameter controlled by an external agent. For a classi¬ 
cal system with time-dependent Hamiltonian, the microscopic 
reversibility Il22l is illustrated in Figure 1. 

We first introduce the forward process for a classical sys¬ 
tem under time-dependent driving. We assume that the clas¬ 
sical system is initialized in a canonical equilibrium 

state at inverse temperature f — I IT at the value T, of the con¬ 
trol parameter, which is described by the Boltzmann-Gibbs 
distribution in phase space, pf[X; 0] = d,) with 

Zip, d;) = f dXoe^^^^^°’'^‘^ being the initial partition function. 
Then the classical system is isolated and driven by an exter¬ 
nal agent, which varies the control parameter d from an initial 
value d, to a final value dy in a time duration t according to a 
specified protocol d(f),f e [0, t]. Then the phase space den¬ 
sity evolves in time under the Liouville equation 

d,pAX; t] = mX; A(t)],pAX; t]), (4) 

where {A,B} = 2^=1 *e Poisson bracket 

in the Hamilton mechanics. Of course usually under time de¬ 
pendent driven, f] d(f)]. However the 

Liouville theorem states that the phase space distribution is in¬ 
variant along any trajectory of the system ll23l . thus one has, 
for Vf 6 [0, t], 

pF[X-,t] - pp[Xq-,0\, (5) 


at Xo at f = 0 [See the upper red line in Figure 1]. According 
to first law of thermodynamics, the work done associated with 
the trajectory in the forward process [The upper red in Figure 
1] only depends on the initial state if the force protocol is fixed 
and we have 


W[XQ\^H[XuAf]-H[XQ-Ail ( 6 ) 

Now we consider the reversed process. In the reversed 
process, the classical system is initialized in a canonical 
equilibrium state at inverse temperature p at the value dy 
of the control parameter, pr(A;0) = e^^^'^^^''^fZ(p,Af) = 
0e-^"[^;''/l©-i/Z(y3,d/) with Zip,Af) = f dXe’^^^^-'^f^ being 
the initial partition function in the reversed process. Then the 
classical system is completely isolated and is driven by the re¬ 
versed Hamiltonian Hj{[X; f] = 0H[X; A(t - f 6 [0, t] 

for a time duration r. The dynamics of the phase space den¬ 
sity for the reversed process at time f is governed by Liouville 
equation li^ 


d,pR[X-t]^{HAX-,t],pR[X-,t]]. (7) 

Of course usually under time dependent driven pR{X-,t\ + 
g-/3H[0X;i(T~o]^2 [^,/((t - f)]. However the Liouville theorem 
states that, for Vf 6 [0,t], 


Pfi[0A(T-f);f] =pfi[0Ai;O]. (8) 


Here 0A(t - f) is the resulting phase space points at time f 
under the dynamics of Hamiltonian in the reversed process 
Hr{X-, f] if it was at 02fi at f = 0 [See the lower blue line in 
Figure 1]. 

Combing Equation Equation (|^, ^ and (|^, we obtain 

-mw-hF) ^ P«[ 02 f(f);T- f] ^ 0 pj;[ 2 f(f);T- f] 0 ~‘ 

"" “ PF[X{t)-t] ~ PF[X{t)-t] ■ ^ ^ 


Here AF s F[p,Af] - F\p,Ai\, t e [0, t] is arbitrary time 
points. Note that on the right hand side of Equation (|^, the 
phase space densities are observed at the same phase space 
point X{t). This is a special case of the generalized Crooks 
relations for classical systems Ii24l . It states that the work 
done associated with a trajectory in phase space is fully deter¬ 
mined by the phase space density in the forwarded process at 
any intermediate time and the phase space density of its time 
reversed process at arbitrary intermediate time. It is a conse¬ 
quence of Liouville theorem in classical mechanics. 

Making use of Equation 0. we have 


- f dXopF(Xo;0)e-^^'^^^oK ( 10 ) 

= J dXpFiX-, t)^-^pRi@X-, T - tf, (12) 

= g-NtsF ^(z-l)S,[pR(@X-,T-t)\\pF(X-t)] ^ (- 23 ) 


where A is the resulting phase space point at time f under the where z is a finite real number and S fpi\\p 2 \ = 
dynamics of forward Hamiltonian F[[X\ /1(f)] if it was initially ln[ J dXpiiXfp 2 (Xf^^] is the order-z Renyi divergence of 
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two probability distributions p\{X) and piQQ iiiiiia. From 
Equation ( [TOl i to ( [TT] i we have applied the Liouville theorem 
dX = dXo and Equation ([^. Identifying the dissipated work 
^diss - W - AF in Equation ([T0ll-([T3), we consequently ob¬ 
tain Equation Q for a classical system. Now we give several 
comments on Equation ([^ for classical system: 

(1) . It relates a fundamental quantity in thermodynamics, the 
dissipated work, to a key concept in information theory, Renyi 
divergences of two nonequilibrium phase space density dis¬ 
tributions. Eor z = 1, Equation Q returns to the Jarzynski 
equality ||T]. 

(2) . The fluctuation of the dissipated work is independent of 
time f because the densities on the right hand side of Equation 
(0 can be evaluated at any intermediate time. While the fact 
that the dissipated work is independent of t can also be seen 
from Il24l 1271 . This time independence is a consequence of 
the Liouville equation in Hamilton dynamics. 

(3) . It is an exact relation between the generating function of 
the dissipated work in a driven process and the Renyi diver¬ 
gences between the phase space density of the forward and its 
time reversed process at any intermediate time of the experi¬ 
ment. Differentiating both sides of Equation ([^ with respect 
to z n times with n - 1,2,3, ■ ■ ■ and then fixing z = 0, we 
obtain the various moments of the dissipated work, 

= In (14, 

where n - 1,2,3, ■ ■ ■ and T is the temperature. In particular 
for n = 1, the mean of the dissipation is Il24l428l 

<W^diss) = r r dXpAX-1) In , , (15) 

J p«(0X;t-O 

^TD\pp{X-t)\\pRm\r-t)], (16) 

where D[pf(X\t)\\pii{<dX-,T - f)] is the relative entropy Il29l 
between forward phase space density distributions and the re¬ 
versed phase space density distributions. If a probability dis¬ 
tribution P{W) has finite moments of all orders {W") in from 
0 to oo) and lk\ has any positive radius of con¬ 

vergence, then all the moments uniquely determine the dis¬ 
tribution ffl. In this case, the characteristic function of the 
distribution is given by. 


G{u) = 2 

n =0 


(iuf 


(W"). 


(17) 


Whose Eourier transform gives the probability distribution. 
Thus Equation ( [T4| l provides a means to obtain the probabil¬ 
ity distribution of dissipated work from non-equilibrium phase 
space density distributions. 

(4). Eor some special values of z, the Renyi divergence re¬ 
duces to distance measures. Eor z = 1/2, we have 

= 1 - \dI[pk(@X-, t - t),pFiX- f)]. (18) 

where D^[P, Q\ - 2"=i( yfPi— squared Hellinger 

distance ED of two distributions P - {pi,p 2 ,-" ,Pn] and 
Q^{q\,q 2 ,--- ,qn]- 


HiAit)), t e [0, r] 



@HiAir r] 


FIG. 2. (color online). Schematic illustration of the time rever¬ 
sal symmetry for quantum system with time-dependent Hamiltonian. 
The upper red line with arrow towards right denotes the forward pro¬ 
cess: it starts at an arbitrary initial state |i) and evolves in time under 
the unitary evolution generated by HiAit')), f e [0, r] for time dura¬ 
tion T. Then the state at time t is \t//it)) = 7”exp[-i dt'//(/i(t'))]|0 
and finally becomes |/) at time t. The lower blue line with arrow to¬ 
wards left is the time reversed process: it starts at ©|/) (time reversed 
state of I/)) and evolves under Hamiltonian 0H(/1 (t - r))® s 
[0, t] for time duration t. Then the state at time t - f is @\iffit)) and 
finally becomes ®|i) at time t. 


Non-equilibrium quantum thermodynamics- Let us con¬ 
sider a finite quantum system governed by a Hamiltonian HiA) 
and T is a parameter controlled by an external agent. We il¬ 
lustrate the time reversal symmetry for quantum system under 
time-dependent driving in Eigure 2. 

Let us first define the forward process in quantum system 
under time-dependent driving. In the forward process, we 
initialize the quantum system in canonical equilibrium state 
at inverse temperature fi - IjT at a fixed value of con¬ 
trol parameter d,, which is described by the density matrix 
PFiO) = e-^"®-VZ(/3,4,) with Z(/3,d,) = Tr[e-^"®->] being 
the canonical partition function. Then we isolate the system 
and drive it by the Hamiltonian HiAit)) for a time duration r, 
where the force protocol /1(f), f 6 [0, t] brings the parameter 
from d, at f = 0 to /!/ at a later time r. Then the state at f in 
the forward process is given by 

PFit)^UFit,0)pFi0)Ulit,0), (19) 

where I/f (f, 0) = Te^‘^ dfwm) ^^h T being the time order¬ 
ing operator. Of course usually p//(f) 4 d(f)]. 

Work in quantum system is defined by two projective mea¬ 
surements iniEi. We assume, for any d, //(d)|ny(d)) = 
E„iA)\nyiA)} and the symbol n labels eigenenergy and y de¬ 
notes further quantum numbers to specify an energy eigen¬ 
state in case of g„-fold degeneracy. At f = 0, the first projec¬ 
tive measurement of i/(d,) is performed with outcome EniAj) 
with probability p„(0) = d,). Simultaneously 

the initial equilibrium state projects into the state, cr„ = 
n„(d,)pf(0)n„(d,)/p„(0) with n„(d) s |«y(d))(ny(d)|. At 
0 < f < T, the system is isolated and driven by a unitary 
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evolution operator Uf(T,0) - Te~‘^o and the state at 

T is (t„(t) - t//r(T, 0)cr„t/ji(T, 0). At f = T, the second pro¬ 
jective measurement of H(Af) yielding the eigenvalue Em{Af) 
with conditional probability Pm|„(T) = Tr[nm(/l/)cr„(T)] is per¬ 
formed. Work is defined by difference of energy measure¬ 
ments. So the probability of obtaining E„(Ai) for the first 
measurement and followed by obtaining E„t{Af) in the sec¬ 
ond measurement is Pn(0)/7„,|„(T). Thus the work distribution 
in the forward driven process is given by iniini 

Pf(W) = ^ Pn(0)Pn,\n(T)6[W - E„{Af) + £„(/!,■)]. (20) 

m,n 

The quantum work distribution Pf{W) encodes the fluctua¬ 
tions in the work that arise from thermal statistics and from 
quantum measurement statistics over many identical realiza¬ 
tions of the protocol. 

Now we define the reversed process in quantum sys¬ 
tem under time-dependent driving. In the reversed pro¬ 
cess, we initialize the quantum system in the time reversed 
state of the canonical equilibrium state at inverse tempera¬ 
ture p - I IT at value Af of the control parameter, p«(0) = 
©e-/^«W/)0-i/Z(je,dy.) with Z(J3,Af) = Tr[e~^"('*/^] being the 
canonical partition function. Then we drive the system by the 
Hamiltonian in the reversed process //«(?) = @H(A{t - f))©“^ 
for a time duration t which brings the force parameter from 
T/ at f = 0 to T, at a later time t. The time evolution operator 
for the forward driven process and its the reversed process are 
related by 021 

t/fi(f,o) = 0t/]:(T,T-f)©^^- (21) 

Then the state at t in the reversed process is given by 

PR{t) = Unit, 0)pR(0)Ul(t, 0 ), ( 22 ) 

where t/«(f, 0) s T e"'JoAlthough prit) and pfi(f) are 
far from equilibrium states, they satisfy the following lemma 
due to time reversal symmetry in the forward process and the 
reversed process: 

Lemma-The density matrices in the forward driven process 
at arbitrary time t e [0, t] and its time reversed processes at 
time T - t satisfy, for any finite real numbers a,b e 

Tr[(0-'p«(T-f)0)“(pF(O)'] = Tr[(0-V«(T)©)“(PF(O))']. 

(23) 


Proof: From Equation and ( |22l l, we have 

0-'p«(T - 0© = &-'Ur{t - t, 0)p«(0)t/;(T - t, 0)0, (24) 
= 4(T,f)©'V«(0)©t/F(T,f)- (25) 

Then 

(0-'pfi(T-^)©)>F(f))^ (26) 

= UliT, t)[&-^pR(0)&y Ur(t, t)UAt, 0)p^(0)4(f, 0),(27) 
= Ufit, OWliT, O)(0-V«(0)©)“t/F(T, 0)p^(0)t/;(f, 0)(28) 
= Upit, O)(0-'p«(T)0)"(PF(O))'’t/;(f, 0), (29) 


which means (0 “'p^(t - t)&f{pf(t)f and 

(0“'pfi(T)0)“(pf(O))^ are related to each other by a uni¬ 
tary transformation Uf{t,Q). They must be equal under the 
trace. Thus we have proved Equation ( [2^ . 

Erom the definition of quantum work distribution. Equation 
(|20l) and the Lemma proved above. Equation (|2^, we have 


: Zr‘Tr[t//r(T, t/])(T, 


Z' 

= ^Tr[ Uf{t, 0)(pf (0 ))''V;(t, O)(0-'pfi(O)0y 


= 4Tr 
Zf 

= 4Tr 
Z' 


= V/i(T-n0lbf (01 ^ 


(pf(T))'‘'(0-'p«(O)0)'], 

(pf(f))‘"'(0-'p«(T-O©)' 


(30) 

(31) 

(32) 

(33) 

(34) 

(35) 


Here z is a finite real number and AF s F\p,Af \ - F\J3,Ai\. 
Erom Equation ( |3^ to Equation ( |34l l, we have used the lemma 
proved above. In the last step, we have made use of definition 
of the order-z quantum Renyi divergence of two density matri¬ 
ces pi andp 2 lEOlini, S^{p\\\p 2 ) = ■^'^t\[Tx[p\p}f^]\, which 
is information theoretic generalization of standard relative en¬ 
tropy lITSl . If we identify IT - AF as the dissipated work Wdiss 
in Equation ( [30l l and ( [T5] l, we therefore obtain Equation Q for 
quantum system. Now we make several comments on Equa¬ 
tion Q for quantum system: 

(1) . It relates a fundamental quantity in quantum thermo¬ 
dynamics, the dissipated work, to a fundamental concept in 
quantum information theory, the quantum Renyi divergences 
between the nonequilibrium density matrix in the forward pro¬ 
cess at arbitrary time t and the density matrix in the reversed 
process at any time t - t. 

(2) . The fluctuation of the dissipated work in quantum system 
is independent of time t because the density matrices on the 
right hand side of Equation Q can be evaluated at any inter¬ 
mediate time. While the fact that it is independent of t can 
also be seen from llZ7lf3^ . This time independence is a con¬ 
sequence of the time reversal symmetry in driven process. 

(3) . It is an exact relation between the generating function 
of the dissipated work and Renyi divergences between a non¬ 
equilibrium density matrix in the forward process at any in¬ 
termediate time t and the density matrix in the reversed pro¬ 
cess at time t - t. Differentiating both sides of Equation Q 
with respect to z n times with n - 1, 2,3, ■ ■ ■ and then setting 
z = 0, we obtain the various moments of the dissipated work 
for quantum system under time-dependent driving, 

= rTr[pf(f)T'„(ln[pf(f)] -ln[0-'p«(T- 0©])"], 

(36) 


where T is the temperature, n - 1,2,3, • ■ ■ and Tn is an or¬ 
dering operator which sorts that in each term of the binomial 

expansion of (ln[p/r(f)]-ln[0“'p«(T-f)©]) , ln[pF(f)] always 






5 


sits on the left of ln[0 ^Pr{t — f)©]- In particular for n - 1, it 
is llTlEllEll 

(IVdiss) = 7’Tr[pf(f)(ln[pf(f)] - ln[0-VR(T - 0©])], 

= 7’D[pHf)ll©^V«(T-f)©], (37) 

where D\pf{X-, f)||pR(©7f; r - f)] is the von Neumann relative 
entropy Il29l 1^ between density matrix in the forward pro¬ 
cess at arbitrary time t e [0, t] and the density matrix in the 
reversed process at time r - f. Recently this result was ex¬ 
perimentally demonstrated by using a nuclear magnetic res¬ 
onance set-up that allows for measuring the non-equilibrium 
entropy produced in an isolated spin-1/2 system following fast 
quenches of an external magnetic held ||3^ . As in the classi¬ 
cal case, if a probability distribution P{W) has hnite moments 
of all orders {W”) {n from 0 to oo) and 2*^0 ‘^k{W‘)lkl has any 
positive radius of convergence, then all the moments uniquely 
determine the distribution OOl . Thus Equation ( [3^ provides 
a means to obtain distribution of dissipated work for quantum 
system driven arbitrarily far from equilibrium from the non¬ 
equilibrium density matrices. 

(4). For z = 1/2, the order-1/2 Renyi divergence is re¬ 
lated to the squared Hellinger distance ED, Dlipupi] = 
Tr[( density matrices pi and p 2 . We 

thus have 

= 1 - ^-DllpRiQX-, T - t),pAX-1)]. (38) 

In summary, we have established an exact relation which 
connects a fundamental quantity in non-equilibrium thermo¬ 
dynamics, the dissipated work in a system driven arbitrarily 
far from equilibrium, to a fundamental concept in information 
theory, Renyi divergences. We hnd that the generating func¬ 
tion of the dissipated work under an arbitrary time-dependent 
driving is related to the Renyi-divergences between a non¬ 
equilibrium state in the driven process at an arbitrary interme¬ 
diate time and a non-equilibrium state in its time reversed pro¬ 
cess at an arbitrary intermediate time. This relation is univer¬ 
sally applicable to both finite classical system and finite quan¬ 
tum system, arbitrarily far from equilibrium. In this work, we 
studied the case that the system is isolated from the bath in 
the time-dependent driving process, it would be interesting to 
study whether the results still hold if the system and bath are 
coupled in the course of driving. 

This work was supported by an Alexander von Humboldt 
Professorship and the EU Projects EQUAM and SIQS. 
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